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ABSTRACT 


In  this  note,  we  further  develop  the  pathwise  convexity  approach  introduced  by  llu  (lUDD)  to 
prove  consistency  of  infinitesimal  perturbation  analysis  for  the  derivative  of  the  siead\ -state  uaitiiu* 
time  of  the  G/G/l  queue.  In  additioti  to  generalizing  the  argument,  we  illustrate  the  tochni<nir  with 
applications  to  stochastic  storage  theory  and  networks  of  queues.  ^ 
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1.  Introduction 

Given  a  stochastic  system  depending  on  a  real-valued  decision  parameter  0^  it  is  often  of  interest 
to  calculate  the  derivative  of  steady-state  performance  measures  with  respect^ to  0,  These  deri\ati\es 
pla\  an  important  role  in  the  sensitivity  analysis  and  optimization  of  such  systems  (see  GKnii  (1990) 
for  further  discussion  of  these  applications). 

Typically,  steady-state  performance  measures  can  not  be  calculated  in  analytical  closed-form.  As 
a  consequence,  it  is  desirable  to  develop  numerically-based  algorithms  for  obtaining  such  deri\ati\es. 
Given  the  inherent  flexibility  and  power  of  simulation  as  a  numerical  tool  for  the  studv  of  btochaslic 
systems,  considerable  attention  has  recently  been  focussed  on  the  question  of  how  to  construct  efficient 
simulation-based  estimators  for  derivatives  of  steady-state  performance  measures.  Two  general 
approaches  to  the  problem  have  been  suggested  in  the  literature:  likelihood  ratio  gradient  estimation 
techniques  (see  Glynn  (1986,  1987.  1990),  Reiman  and  Weiss  (1989),  and  Rubinstein  (1986))  and 
infinitesimal  perturbation  analysis  (see, Tor  e.xample,  Suri  (1987),  Ca6-(1988),  and  Glasserman  (1988)). 

This  note  discusses  infinitesimal  perturbation  analysis  (IPA),  and  can  be  viewed  largely  as  an 
elaboration  of  the  basic  ideas  presented  in  Hu  (1990).  A  major  theoretical  concern  with  IPA  is  the 
question  of  consistency.  In  our  current  setting,  IPA-  is  said  to  be  consistent  if  the  IPA  derivative 
estimator  converges  in  probability  to  the  derivative  of  the  steadyrstate  performance  measure.  It  is 
known,  however,  that  IPA  need  not  be  consistent  when  applied  to  certain  types  of  systems,  such  as 
queueing  networks  having  multiple  customer-types  (see  Heidelberger  et  al  (1988)).  As  a  consequence, 
IPA  consistency  continues  to  be  a  major  theoretical  issue. 

Recently,  Hu  (1990)  developed  an  elegant  approach,  based  on  convexity,  for  proving  consistency 
of  the  IPA  derivative  estimator  in  the  context  of  the  G/G/1  queue.  In  this  note,  ourprincipal  objective 
is  to  show  that  Hu’s  convexity  technique  is  a  powerful  tool  that  can  be  useful  in  a  significantly  broader 
setting  than  that  of  the  single-server  queue. 

2.  The  Convexity  Appro^h  for  Obtaining  IFA  Consistency 

Consider  a  real-valued  discrete-time  sequence  X  =  (Xn  :  n  >  0)  representing  the  output  of  a 
simulatiori.  Suppose  that  the  probability  P  governing  the  distribution  of  X  depends  on  a  real-valued 
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decision  parameter  0.  (We  specialize  to  real- valued  decision  parameters  and.  discrete-time  only  in  order 
to  simplify  our  exposition;  the  same  ideas  easily  extend  to  vector  decision  parameters  and/or 
continuous-time  processes.)  To  denote  the  dependence  of  P  on  0,  we  write  it  as  P^. 

We  assume  that  for  each  0  in  some  open  interval  A,  the  sequence  X  has  a  well-behaved  steady- 
state.  More  precisely,  we  assume  that  for  each  0  €  A»  there  exists  a  deterministic  constant  a{0)  such 
that 

^  'E  X;.  -  m  ?e  a.s.  (1) 

kzzO 

as  n  — *  CO.  The  constant  a(0)  then  represents  the  steady-state  mean  of  X  under  P^.  The  literature 
abounds  with  various  mathema  ical  techniques  for  establishing  the  law  of  large  numbers  (1)  (eg. 
Markov  process  techniques,  stationary  process  theory,  regenerative  analysis). 

The  basic  idea  underlying  IPA  is  the  construction  of  a  single  probability  space  (fi.  P)  and  a 
collection  of  random  variables  {X«(/?)  :  i\  >  0  e  A)  such  that: 


For  each  0  €  A,  c  =  P^{X  €  •},  where  X{9)  =  {Xn{0)  t  n  >  0).  (2) 

Assumption  (2)  asserts  that  the  distribution  of  the  sequence  X(0)  under  P  is  identical  to  that  of  X 
under  P^.  One  (standard)  way  to  construct  a  probability  space  satisfying  (2)  is  to  use  the  method  of 
common  random  numbers  to  drive  each  of  the  processes  X(0),  0  e  A. 

In  addition,  IPA  demands  that  the  construction  of  (fi,  P)  be-carried  out  in  such  a  way  that 
the  behavior  of  Xn  =  (Xn(^)  :  0  £  A)  is  suitably  smooth.  Im  this  note,  we  shall  employ  a 
pathwise  convexity  assumption,  namely: 

For  each  n  >  0,  w  £  fi,  Xn(*,  w)  is  convex  in  6  over  A.  (3) 

Assumptions  (T),  (2),  and  (3)  guarantee  that  the  deterministic  function  Gr(-)  can  be  appro.ximated 


well,  in  some  uniform  sense. 


PROPOSITION  1.  Suppose  a,  b  c  A,  where  a  <  b.  Under  (1),  (2),  and  (3)» 


P{Xn(*)  converges  uniformly  to  q(*)  on  [a,b)  as  n  —  co}  =  I  . 

where  Xn(^)  =  n“^  ^ 
k=o 

PROOF.  Let  =  {u;  :  Xn{0^  u>)  —  q(^)  as  n  —  and  Q  be  the  set  of  rational  nmnbors 

contained  in  A.  VVe  first  show  that  P(A)  =  where  A  =  n,  A^. 

eeQ 

By  assumption  (2),  P(A^)  =  P^(B^),  where  B^  =  {w  :  n"^  ^  ^ki^)  «((?)  as  n  —  cc}.  But 

t=o 

(1)  guarantees  that  Pp(B/>)  =  1.  Since  Q  is  countable,  it  follows  that  P(A)  =  1. 

Let  C  =  {a;  :  Xn(-,  converges  uniformly  to  q(-)  on  [a,b)  as  n  —  co}.  By  (3).  it  is  evident  that 
X„(n  is  convex  in  0  for  each  n  >  0  and  a;  e  fi.  Hence,  wc  may  apply  Theorem  lO.S  of  Rockafellar 
(1970)  to  conclude  that  A  C  C.  It  follows  that  P(C)  ==  1,  proving  the  proposition. 

A  consequence  of  Proposition  1  is  that  there  exists  a  set  having  probability  one  on  which 
converges  at  each  ^  c  [a,b]  simultaneously.  As  Hu  pointed  out,  this  permits  one  to  appiv  Theorem  *25.7 
of  Rockafellar  (1970).  (Note  that  any  Oq  c  A  can  be  embedded  in  some  closed  interval  [a^b]  C  A.)  The 
following  theorem  is  a  generalization  of  the  consistency  result  found  in  Hu  (1990).  It  proves  that  the 
time-avcragc  deriyative  converges-a.s.  to  the  steady-state  derivative  at=  almost  every  point  0q  c  A,  The 
proof  follows  easily  from  Proposition  1  above  and  Lemma  1  of  Hu  (1990),  and  is  therefore  emitted. 

THEOREM  1.  Assume  (1),  (2),  and  (3)  and  let  6q  be  a  point  at  which-a(-)  is  differentiable.  Then, 

Xn\0o)  -  P  a.s. 

-  -  j  n-l 

as  n  —  oo,  where  Xn'(^o)  =  H  XUOq)  is  the  right-hand  derivative  of  Xj.(*) 

k=0 

evaluated  at  0o» 
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Since  a(’)  is  the  pointwise  limit  of  a  sequence  of  convex  functions,  it  is  evident  that  (if-)  is 
convex  (Theorem  10.8  of  Rockafellar  (1970)).  Consequently  a  is  differentiable  e.vcept  (possibly)  on  a 
countable  subset  of  A  (Theorem  2(  3  of  Rockafellar  (1970)).  Theorem  1  asserts  that  IPA  is  consistent 
wherever  the  steady-stale  performance  measure  is  smooth.  Smoothness  of  the  function  q(-)  (at  all 
points  0  €  A)  can  be  established  by  techniques  that  are  independent  of  IPA  (for  e.\ample,  likelihootl 
ratio  methods). 

3.  EXAMPLES 

In  this  section,  we  illustrate  Theorem  1  with  some  e.\amples  that  arise  as  solutions  to  a  certain 
class  of  stochastic  recursions.  Let  g  :  (R*"*"'  —  R  satisfy: 

i)  g(x,y)  is  convex  in  (.\,y)  c  R  x  R*^, 

ii)  g(x.y)  is  non-decreasing  in  (x,y)  c  R*'*'*,  in  the  sense  that  if  x,  <  Xo  (component-wise), 
y,  <  yo,  then  g(x„yi)  <  gf.Xj.yo). 

For  a  given  stochastic  sequence  Y  =  (Y„  :  n  >  1)  (Y„  e  R*),  consider  the  real- valued  se(|uence 
.\  =  (X,i  :  n  >  0)  defined  by  Xq  =  Xq  (Xq  deterministic)  and 

X,.+,  =  g(X,.,  Y„^i)  (4) 

for  n  >  0.  Assume  that  under  the  distribution  P^,  (Yn  :  n  >  1)  is  i.i.d.  with  common  distribution  F^. 
It  is  easily  seen  that  X  is  then  a  real-valued  Markov  chain  under  Pj. 

To  apply  IPA  to  the  calculation  of  steady-state  derivatives  of  the  sequence  X  defined  by  (4),  we 
shall  assume  that  there  e.xists  a  r.v.  Y*,  a  distribution  P*,  and  a  function  h  :  R*'*'*  —  R*^  such  that: 

iii)  Fj(dy)  =  P’{h(</,Y')  £  dy)  for  ail  0  £  R,  y  e  R*", 

iv)  h,(‘  ,  y)  is  convex  for  y  £  R*,  1  <  i  <  k,  where  h,-  is  the  i’th  component  of  h 
(i.e.  l\(0,y)  =  (lti(0,y),  ...  ,ht(<?,y)). 


Let  P  be  the  distribution  under  which  Y  =  (Yn  :  u  >  1)  is  a  sequence  of  i.i.d.  copies  of  Y“  (generated 
under  P’)  and  set  Xo(0)  =  Xq,  with 

X„+iW  =  g(Xn(tf),h(0,Y„^O)  (5) 

for  n  >  0. 

PROPOSITION  ’2.  Under  assumptions  i)  -  iv)  above,  the  above  construction  of  P  and  the  r.v.'s 
{Xn(fl)  :  11  >  0,  0  e  R}  satisfies  (2)  and  (3). 

PROOF.  Assumption  (2)  is  obvious.  As  for  (3),  we  can  prove  this  inductively.  Note  that  Xo(‘)  is 
trivially  convex,  and  assume  Xn(0)  is  convex  in  0,  We  need  to  show  that  X,j^i(^?)  =  g(Xn(^)»  h(^, 
Y,j^j))  is  convex  in  0.  But,  by  assumption  iv=),  each  of  the  k  +  1  arguments  g  is  convex  in  0, 
Assumptions  i)  and  ii)  then  guarantee  the  convexity  of  This  follows  from  an  'asy  modification 

of  Theorem  5.1  of  Rockafellar  (1970). 

With  Proposition  2  in  hand,  we  need  only  verify  (1)  in  order  to  apply  Theorem  1.  This  must  be 
done  on  a  case-by-case  basis  (since  the  Markov  chains  defined  by  (4)  need  not  be  positive  recurrent). 

EXAMPLE  1.  Consider  the  waiting  time  sequence  W  =  (Wn  ^  n  >  0)  associated  with  the  GI/G/1 
single-server  queue.  As  is  well  known,  the  waiting  time  sequence  in  a  single-server  first  come  first  serve 
queue  takes  the  recursive  form 

=  (W„  +  V„  -  (6) 

for  n  >  0,  where  Vn  represents  the  service  tinie-of  the  n’th  customer  (n  >  0)  and  corresponds  to 
the  inter-arrival  time  between  the  n'th  and  (n4-r)'st  customer  to  the  system.  This  is  a  special  case  of 
(4),  in  which  Y„+i  =  (Vn,  -  U„+i)  and  g(x,  yi,  y,)  =  [x  +  yi  +  yoj"^.  We  note  that  g  is  the 
composition  of  a  convex  non-decreasing  function  (namely,  [x]"^)  and  a  linear  function  (namely,  x  +  j'l 
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+  y-j),  and  lienee  is  convex.  Furtliennoie,  g  is  non-decreasing  in  each  of  its  arguntenls.  so  tlial  it 
tlierefore  satisfies  i)  and  ii). 

If  we  assume  that  V  =  (Vo:  n  >  0)  and  li  =  (Un  :  n  >  1)  are  independent  sequences  of  i.i.d. 
random  variables  under  P^,  tlien  VV  is  a  Markov  chain.  If  we  further  require  that 

P(,{Vn  £  ■}  =  P{I?  V„  £  .} 

(7) 

Ps{Un+i  ^  •}  =  P{0„+,  f  •}  - 

then  the  sequence  Wn(0)  takes  the  form 

w, .+,«?)  =  0  \^.  -  (8) 

Hence,  Proposition  2  applies,  thereby  proving  that  (VV„((?)  :  n  >  0,  <?  £  A)  satisfies  (2)  and  (3)  on  any 
open  interval  A  of  R.  Furthermore,  it  is  known  (see  Wolff  1989)  that  if  EV?,  <  oo,  then  the  law  of 
large  numbers  (1)  is  valid  at  any  $  satisfying  0  <  E0„+,/EV„.  Under  the  above  conditions,  it  is 
therefore  evident  that  Theorem  1  may  be  applied  to  the  sequence  W,  proving  validity  of  IPA  ;it  all  but 
(possibly)  many  countably  0q  £  (0,  EU„  +  l/EVn). 

We  further  note  that  (7)  can  be  modified  in  several  ways  without  affecting  the  basic  validity  of 
IPA.  For  example,  Proposition  2  continues  to  apply  to  changes  in  location  in  the  service  time 
distribution  (ie.  P^{Vn  €  ■}  =  P{Vn  6  c  •})  cis  well  as  scale/location  changes  in  the  intcr-arrival 
time  distribution  (ie.  €  •}  =  P{0  e  •}  or  P{U„4.i  +  0  c  •}). 

EXAMPLE  2.  In  this  example,  we  consider  a  class  of  nonlinear  storage  processes  that  were  introduced 
by  Klemes  (1978).  Given  a  reservoir,  we  let  Sn  be  the  storage  at  time  n,  and  let  denote  the  inflow 
during  period  n  +  1.  If  the  outflow  during  period  n  -h  1  is  assumed  to  be  a  power  of  the  storage  at  time 
n  +  1  (ie.  outflow  equals  a  S^+i  for  some  a,  b  >  0),  then  we  conclude  that  the  sequence  (Sn  :  »  >  0) 
must  satisfy  the  mass-balance  equation 
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Sfi+i  Sn  +  -  a  S,|+|  •  (9) 

Hence,  $,^4.1  =  v(Sn  +  where  v  is  the  inverse  function  to  u(x)  =  x  -f  ax^.  We  note  that  if 

So  >  0,  the  sequence  (Sn  t  n  >  0)  takes  values  in  (0,co).  Furthermore,  u  is  twice  continuously 
differentiable  on  (0»oo)  with  u'(x)  =  1  +  ab  x^”\  u"(x)  =  ab(b-l)  x^""".  But  v(u(x))  =  x  and  hence 

v'(u(x))  u'(x)  =  0. 
v''(u(x))u'(x)-  +  v'(u(x))  u"(x)  =  0, 

from  which  we  may  conclude  that  v''(y)  =  -  u^'(v(y))/u'(v(y))^.  It  follows  that  v  is  convex  (concave) 
on  (0,co)  if  0  <  b  <  1  (b  >  1).  Thus,  if  0  <  b  <  1,  it  is  evident  that  g(x,y)  =  v(x  +  y)  satisfies 
coitditions  i)  -  ii)  of  Proposition  2.  If  we  further  require  that  under  P^,  Y  =  (Y,,  :  n  >  0)  is  a  sequence 
of  i.i.d.  random  variables  for  which 


P,{YnC  •}  =  P{0YnC^}, 


the  conditions  of  Proposition  2  are  in  force  and  the  sequence  S(0)  =  (S«{(?)  :  n  >  0)  given  by 

SoiO)  =  So  >  0, 

s„+i(^)  =  y(Sn(0)  + 

satisfies  (2)  and  (3).  Furthermore,  we  prove  in  the  Appendix  that  if  EYn  <  00,  the  strong  law  (1) 
holds  at  every  ^  >  0  (with  Sn(^)  playing  the  role  of  Xn).  Hence,  Theorem  1  proves  that  IPA  applies  to 
steady-state  derivative  estimation,  for  the  class  of  storage  models  discussed  here,  provided  the  power 
law  exponent  satisfies  b  <  1. 

In  fact,  it  turns  out  that  IPA  also  applies  when  b  >  1.  Let  Sn  =  -  Sn,  Yn  =  -  Yn,  and  g(x,y)  =  - 
g(-x,-y),  so  that  =  g(Sn,Yn).  Assuming  EYn  <  00,  one  may  then  apply  Theorem  1  to  the  ciiain 
(Sn  :  n  >  0)  to  prove  consistency  of  IPA. 
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EXAMPLE  3.  In  this  example,  we  prove  that  IP  A,  in  certain  queueing  network  settings,  is  typically  a 
consistent  estimator  of  the  derivative  of  the  mean  steady-state  waiting  time  (with  respect  to  service 
time  perturbations)  at  any  first-come  first-serve  infinite  capacity  queueing  station.  We  further  assume 
that  the  queueing  network  is  a  feed-forward  network,  so  that  customers  can  not  loop  back  to  the 
station  with  positive  probability.  The  argument  hinges  on  the  fact  that  the  recursion  (6)  continues  tc 
hold  at  such  a  station.  The  sequence  of  inter-arrival  times  (Un  J  n  >  1),  although  no  longer  i.i.d.,  is 
unaffected  by  a  perturbation  in  the  service  times  at  the  station.  In  particular,  (8)  continues  to  hold, 
when  the  perturbation  considered  is  a  scale  change  in  the  distribution  of  the  service  times.  As  a 
consequence,  the  Wn(0)’s.  as  in  E.xample  1,  continue  to  be  convex  in  6.  Thus,  if  the  strong  law  (1)  can 
be  shown,  in  the  network  setting,  to  hold  on  some  open  interval  A,  IP  A  consistency  follows  (as  in  the 
proof  of  Theorem  1),  in  the  sense  that  the  IPA  derivative  estimator  will  converge  e.xcept  (perhaps)  at 
countably  many  points  e  A. 

In  light  of  the  power  of  this  technique,  it  seems  worth  exploring  necessary  conditions  for  its 
applicability.  We  note  that  if  a  suitable  probability  space  can  be  constructed  on  which  (l)-(3)  hold, 
then  for  any  non-decreasing  convex  function  f, 

Jb=0 

is  convex  in  9  (since  the  composition  of  a  non-decreasing  convex  function  with  a  convex  function  is 
convex).  Suppose  that  there  exists  a  steady-state  distribution  ir{6)  for  which  the  strong  lav/  holds,  with 
limit  given  by 

^  E  f(Xfc(0))  -  f  f(x)x(0,dx). 

t=0  R 

a.s.  as  n  — »  00.  Such  strong  laws  typically  hold  for  Markov  chains.  Because  convexity  is  preserved 
under  pointwise  limits,  it  follows  that  in  order  for  a  probability  space  satisfying  (l)-(3)  to  exist, 
evidently 

a(f;  9)  A  J  f(.x)  T(<?,dx) 

~  R 
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must  be  convex  in  6  for  any  convex  non-decreasing  function  f  for  which  the  strong  law  holds.  This  is  a 
necessary  condition  for  the  pathwise  convexity  argument  used  in  this  paper  to  be  applicable. 

To  conclude  this  section,  we  note  that  the  storage  system  studied  in  E.xample  2  need  not  be 
regenerative.  In  particular,  let  b  =  a=  1  and  let  (Yn  :  n  >  1)  be  a  sequence  of  i.i.d.  Bernoulli  (1/2) 
r.v.’s.  In  this  case,  it  is  easy  to  show  that  the  uniform  distribution  on  (0,2]  is  a  stationary  distribution 
for  (Sn  :  n  >  0).  Suppose  Sq  =  x*  If  there  existed  some  embedded  regenerative  structure  in 
(Sn  •  n  >  0)  such  that  (Sn  •  n  >  0)  could  then  be  viewed  as  a  positive  recurrent  regenerative  process,  it 
would  follow  that  for  any  bounded  (measurable)  f, 

n  ’E  f(St)  -  f  f{x)  dx/2  a.s. 

Jt=0  0 

as  n  —  CO.  Let  B  =  (x  +  j  2“^*  :  k  c  Z},  and  note  that  Sn  e  B  a.s.  Setting  f(x)  =  I(x  c  B),  we  find 
that  the  left-hand  side  of  the  above  limit  relation  is  identically  one,  whereas  the  right-hand  side  is  zero. 
We  conclude  that  (Sn  ‘  n  >  0)  can  not  be  viewed  as  a  positive  recurrent  regenerative  sequence.  The 
importance  of  this  point  is  that  the  pathwise  convexity  argument  employed  in  this  paper  can  be  used 
to  establish  IPA  consistency  for  certain  types  of  non-regenerative  systems.  Recent  work  of  Glasserman. 
Hu.  and  Strickland  (1990)  provides  conditions  for  consistency  of  IPA  in  the  regenerative  stochastic 
process  setting.  Thus,  our  work  in  this  paper  can  be  viewed  as  complementary  to  that  of  Glasserman 
et  al  (1990). 

APPENDIX 

We  prove  here  that  if  EYn  <  oo,  then  the  storage  sequence  (Sn(^)  i  n  >  0)  defined  by  (9)  obeys 
a  law  of  large  numbers,  in  the  sense  that  for  every  ^  >  0, 

i  E  SkiO)  a.s. 

jtsO 


as  n  — ^  x>,  where  the  constant  a(0)  is  deterministic.  By  Glynn  (1989),  the  Markov  chain 
(Sn(^)  J  n  >  0)  has  a  unique  stationary  distribution  7r(^).  Furthermore,  E^(^)Sn(^)  <  oo  under  the 
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condition  EYn  <  oo.  By  applying  the  ergodic  theorem  for  stationary  sequences,  it  follows  that  if 

P{So(0)  c .}  =  w(e), 

^  E  W)  -  m  a.s., 

Jt=0 

where  Z(6)  is  the  conditional  expectation  of  So(^)  with  respect  to  the  invariant  cr-field.  Furthermore, 
Glynn  (1989)  proves  that  Sn(0)  •’  Sn(^)  —  0  a.s.  as  n  —  oo,  where  Sn{0)  is  a  storage  sequence  that  has 
initial  condition  So(0)  =  x  >  0  and  is  driven  by  the  same  sequence  of  inflows  as  S«((?).  As  a 
consequence,  the  above  strong  law  continues  to  hold  with  So(0)  distributed  arbitrarily.  We  may  also 
conclude  that  r(x)  =  Pr{Z(^)  c  B)  is  independent  of  x  (for  any  B),  where  Pi(*)  =  P{*  |  So(^)  =  x). 

To  complete  the  proof,  we  need  to  show  that  Z(0)  is  a  constant  a.s.  Using  both  the  Markov 
property  and  the  fact  that  Z(0)  is  invariant,  we  find  that 


K{iSo{0).--M0))  C  •,  Z{e)  e  B)  = 


EWl(So(0),...,Sn(0))  €  .)  r(Sn(0))}. 


Since  r(*)  is  constant,  we  conclude  that  the  above  probability  equals 


PT{{So(9)...Sn(0))  ^  •}  Pr{Z(^)  ^  B}  . 


Hence,  if  r(x)  >  0.  we  obtain 

Pi:{(So(0),...,S„(0))  c  •  I  2(9)  e  B}  =  PH(So(^),...,S„(S))  e  •}. 

As  a  consequence,  we  have  that 

Pi{SW  c  ■  I  Z(0)  c  B}  =  Pi{S(<?)  c  •}. 

But  2{9)  is  a  function  of  S(^)  =  (Sn(^)  :  n  >  0)  so  for  any  (measurable)  A,  we  get 


Pir{Z(0)  €  A  I  Z(0)  C  B}  =  P'r{Z{e)  €  A}, 
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Taking  A  =  B,  we  have  proved  that  if  P5c{Z(tf)  <  B}  >  0,  then  Pt{Z(0)  c  B}  =  1.  In  other  words,  for 
any  D  P'x{Z{S)  c  B}  is  either  zero  or  one.  It  is  easy  to  see  that  this  implies  Z{6)  is  deterministic. 
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